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This report is a^i evaluation of a sel'ected New York 
City Umbrella program funded under. a special grant from the New York 
State Legislature. The program, which served eighty children in twq^ 
Brooklyn schools, focused on the early identification of learning 
problems and the remediation of these problems in first and se'cond 
grade cjiildreri in each of these schools; Forty children selected from 
each school were given remedial work in reading and mat hem^artics. Four 
educational assistants under the supervision of th^ reading 
^specialists of each school comprised- the staff. The specific / - 

evaluation. objectives of the program were that participants attending 
fifty percent or mere of the soiicduled program sessions^ show 
statis'ticaly significant- improvement in reading and mathematics 
skills over the anticipated gain as' m.easured by a comparison of pre 
and pcst-test scores using the historical regression formula.^ The 
Stanford E^rly SchcoV Achievement Test II and the Metropolitan 
Achievement Test werA-used to measure functioning reading and in 
aafhematics. An anal'ysis of the data yielded mixed^esults with 
statistical significance only -partly achieved,. The .results must b^^ 
regarded as tentative due to the short duration *of the program (one^ 
senvester) , the use of two instruments instead of one, and the sma*ll 
sample sizes. Data summaries and a list cf recommendations are 
included in the report. (Author/BS) V 
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Chapter I: / THE PROGRAM 

The Early Identification Program was operateci from Febn^ary .of 1976,' 
until June of 1976 in ,P.S. 139 Brooklyn and P.S. -152 Brooklyn. -It focused ^ 
on the early identification of learning problems, and the remediation of 
these problems in firs-t and second grade children in each of those schools. 
Children we^e selected on the basis of achievement scores being one year 
below' expected grade level for the'^^ond graders, and on the basis of 
indications of serious learning problemsNin reading and mathema^tics for 
first graders. Second graders were selected as.a result of' testing at the 
end of the first grade in the Spring of 1975; First graders we're selected 
on the basis of a score of 5 or below on the Search Test for screening 
children with potential learning disabiTities , * 

A tortal of eighty children parti^cipated /in the program,- ^^^V ^^om 
each school. The forty children selected *from each school were ^iven 
remedial work in both reading and matheinatics , * Children were tested using 
diagnostic reading and mathematics tests, ^su^lly adminis tered ^by the 
feading spec ialis ts"^in each s'chool. A total of f our - Educat ional Assistants* 
were employed in the program Co work directly with the children under* the 
supervision of the reading specialists of eactv school. Each Edu<!:at ional 
Assistant worked with twenty children, seeing each child daily for a period 
of thirty to forty minutes in groups of two to four children, 

■ \ ■ , 

. The instruction of the children followed the educationab prescription 
which had been developed and was supe^rvi^sed by the^^ading Specialists. Each / 
of the childreK^, deceived <dS"ily tutorial or small group it^^truction in both 
reading and mathematics « The ins tructional program consisted of practice in. 
basic, sound* discrimination, letter recognition, phonics work, the . ident if icat ion 



of begitming words in read ing, ''and visual and auditory perceptual task 
practic^ as a part. of reading readiness activities. The work in remedial 
mathematics included work on number concepts, numJjcr sequences^ simple 
addition and subtraction facts, problem solving concepts of space and 
size as well as other elementary mathematics constructs. Both the remedial 
reading and math instruction utilized a great var*iety of games, puzzles, 
l.^ndyliighly motivating activities to, reinforce alid facilitate the learning.. 
T\\e first project" object ive focused on the goal ^f Jt^lpih-g ' 
students achieve s ta t i^s t ica lly s ignif i can C growth in reading skills 
^ring this'^very ^arly phase of their elementary school program, A 
-frecoad program objective focused on providing statistically significant 



Jsc 



growth in mathematics functioning during ithis first and second ye^^ of 
school. Hopefully, this program' wouid identify students who mi^t later 
be serious academic problems, and would provide appropriate remedial work 
at this darly point so that the problems would not become magnified at a 
later date^ » ^ ' 

Chapter II: EVALUATIVE PROCEDURES . ' 

/ ■ ' 

Apart from the discrepancy analysis, this project had two major 

' ■ » • 

evaluat^ign objectives as listed below, . , . , " 

Evaftuation Objective #1 : As a result oT participating in the 
program, pupils attending 507o or more of the scheduled program sessions 
will improve significantly in readiTig skills over the anticipated gain 
as measured by a comparison of pre-test and post-test scores usijig the 
'historical regression f orrnu la . ^ 

Evaluation^QbjeMStj:^ #2 : ■ As a result of participating in the 
corrective mathematics component those pupils attending , 507o or iffore o^f 
the scheduled sessions will improve significant ly in mathematics over the 
anticipated gain asr measured by a comparison of pre-*t^st and post-test 
scores usj^g .the historical regression formula. . . 



. For the first evaluation objcct^ive, slgnifjlca^nt improvement in 
reading, two ipstruments were used, Pre-testing was done during the monDh 
of February and early March ^of 1976^ and the post-testing was done during 
the^last week of May 1976. All first grade pupils were tested" in reading 
using' the S.E.,S.A.T. II (Stanford Early' School' Achievement Test II,) 
For; th^ second grade f?upils both the S%E.S-A.T, II and the Metropolitan - 
Achievement Test (M.A.T.) were used to measure functioning in Reading. . 
Forms B' and F of the Primary Battery of the Metropolitan Achievement Test 
were used for pre-testing and Foirm G for the pos t- tes t Ing, ^ • 

There were fifty-seven pupils tested with the reading sJ|z>-tests of 
the S.E.S.A.T. it on a pre. and post test basis. This instrument ^r^orts 
scores on both a ra^ ^core and a percentile score basis. It ^hould be 
noted that contrary to the proposal / second grade puj|j^3^were tested, 
using the S.E.S^A.T. II instead of the. M. A. T. - A correlated t test was 
run between pre-test scores and post-te^ -scores using the "Pre-test/ 
^ost-test (no controls) Design.** , ' 

An additional sevente&n (17) second grade pupils were- tested using 
the readiitg sub-ti^est of the Metropolitan Achievement Test on a pre and 
post basis. The "Re^l (treatment) Post-Test vs. Anticipated (without 
treatment) Post-Test .Design" was used for this analysis., A total oi. \k 
pupils were both pre and post teste^d. Three pupils transferred put of the 
program during the program. An additional three pppils were absent for 
the post- testing. A total of "80 pupi Is^were ^serv^d in the -Readi^ program 
as specified in tlie projec^t proposal*. 

For the second evaluatipn objective, significant improvement in 
mathematics functioning, two instruments were used. Pre-testing was done 



during the month of February and early March^ of 1976^ and the post-testing 
vas done during t^he last weCk of May 1976. All firai grade students and 
some of the second grade students were testpd using the S.E.S.A.T. II 
(Stanford Early School Achievement Test II). . Some -of the second grade 
students were tested using the Metropolitan Achievement Test. Forms B 
^nd F of the Metfopplitan Achievement Test, Primary Battery, were lised 
for pre-testing and Form G for the post-testing. » 

There were, fifty-six students tested with the mathematics sub-, 
test of the S . E .S . A. T. . If on a pre and post test basis. Tliis instrument 
ve^^rts scores on both a raw and a percentile basis. 3in«e part of ^ 
this sample were second grade students, for whom there are no percentile 
norms, that part of, the data was analyzed using raw scores only, A 
correlated ttest was run between scores for pre and post tests using 
the *^Pre-test / Post-test (no controls) Design." . ' 

An additional seventeen (17) second grade students were tested 

V 

using the mathematics sub-test of the M.A.T. on a pre and post basis, 
fhe "Real (treatment) Post-test vs . Anti'cipTated (without tVeatment) Post- 
test D^^ign" was used" for this analysis. In the second evaluation objective 
a total of 73 s tudepts* were tested on a pre and post basis. Three of the' 
students were transferred out of the program, and four students, fa-iled to 
complete phe post-testing. A total of 80 students were served in the 
Mathematics program as specified in the project proposal. 



Chapter m : FINDINGS ■ * • 

The first objective related to significant' improvement in reading 
skills, for pi I students who participated in at least 50% of the .sess ions . 
As was indicated earlier in this. report, the* types of t^esting prciisented the 
need for several analyses. Thirity-one first graders were pre and post- 

» • * 

tested using the S.E.S.A.T. II, which is designed to be us^d in the first 
grade and gi\^es percentile equivalents for several times witliin the first 
• year o'f. school. Ta^o 1 presents the data o/i those first grade students. 

Table 1^ - Suhimary of Reading Data from First Grade S.E.S.A.T. II, 
Pre and Post Testing. 

.Group N Value of Level of Pre-T£st Post-Test 

^ ^ t Significance Mean Mean . 

f ' ^' ■ 

Grade 1 31 . ^ + l • Q30 'r N.S, 14.6 X 16.3% . 

^ ~— — — ^ 

* Table I suggests that while there was some improvement from March 

to May of 1976, 14.6 percentile to 16.3 percentile, the degree of growth 

was not significant at the .OS^level. Table 2 presents the data for thosje » 

second grade students who were tested, using the S.E.S.A.T. II, which does 

■ ^ - 

not give percentile norms for second graders. Thus the analysis was done 
and the results are given in tenns of raw scores. 



Table. 2 - Summary -of Reading* Da 'ta from Second Grade Raw. Scores ' on 
S . E.S .A.T. . II , Pre and'Post ComparisQn. 



Group N Value of Level of Pre-Test Post-Test 
^ ■ J' ■ t ^ ' ^ Significance Mean Mean 



Oracle 2 


26 


+ .5.504 


' ■ ■ ■ ,. - 

.• .01 ; : ■ ' .\ 110.31 


f — [ 

122.69 


U_ 











Table 2 'suggests a significant positivjg, shift in raw scores or" the*. 



S.E.S.A.T. II Cor second grade students who wore testod with this 

ins t rumen t 

Vicrc wero a (so 17 second grade students who were tested using the 
Metropolitan Achievement Test (M.A.T.) .in agreement with tlie project design. 
. Table 3 presents the data for these students using the historical regression 
fonnula requlllitcd . i n this, part of the evaluation des ign , conipar ing the ■ 
actual post-test 'score with an antiicipated post-test scoric^, , ' 

Table 3 - Summary of Reading Data for Second Grade Students on 
, the M.A.T. , Using the Historical Regression Analysis? 

Group N Value of Level of Pre-Test Anticipated. Actual 

. _t Significance. ,Mean ' Post M.ean . Post Mean 

Grade 2 17' - 3.527 .01 ' 1.45 1:53- 1.36 

■ — '■ ■ ; I . 

i . . ' ' • 

Table 3 suggests that the students Who were tested using the 

Metropolitan Achievement Test presented a decrease in functioning from 

March to May of 1976. The post'test mean score for the group did not exceed 

the anticipated post rmean score calculated using the historical r-egression 

formula. The actual post test meaji? was significantly lower, than the mean 

.which had b^en anticipated.. • . • . 

The second objective of tiki's project focused on significant . 

improvement in mathematics functioning as a result of the remediat ion provided 

in the program-. As in the c^se of the data on the reading functioning, the 

data for the mathematics funct ioning h^ . to be analyzed in three separate 

groups, since different instruments wet:^ used for the different grade levei^, 

and since some of the second gi>aders used a ,tes t wh ich Vas normed on^fl^st 

grade students and those scores could not be changed to percentile scores 

and grouped with the fiirfet grade scores.. Table 4 presents, the data for 



]0 first giwjiv studcMUs who wore lost'od using tho S.E.S.A.T. II, nvithonvUlcs 
sub-Lust, in terms of pcrconLile scores. ^ 

Table 4 - Sunmary of Mathematics Data for First. Grade on I he 
"^.E.S.A.T. TI, Using Percentile Scores. 

Group N , Value of Level *of Pre-Tcst 'Post-Test 
^ ' ■ ' t ^ Signif i cance Mean Mean 

Grade I ' JO J.'>33 .01 9.8 7, 19.0 7. 

^ : , : fl , 

Table 4 suggests that the first grade students in this program w^nt 
from a pt^rcentile mivin of 9.8 7, up to a mean percentile at the post test of. 
• 19.0 7. The t value of +3.')33 was s ignif leant at the ,01 level, of . 

significance suggesting that there was significant improvement in mathematics . 
tunctioning. Table 5 presents the data for the second graders (26) who were 
tested using the S.E.S.A.T. II. Since no conversion tables were used, 
only raw scores could be jdea 1 1 w^th 'in this comparison. 

• / 

Table 5 - Summary of Mathematics Data" from Second Grade Raw Scores 
on' the S .E. S.A.J. II, Pre and Post Comparison.. • * , . 

Group N Value of Level of Pre-Test Post-Test 

^ ' ^ t S ignif icancc Mean Score' Mean Score 

* ■ - 

Grade 2 26 ^ +2.673 J ,05 38.1 4I;3 

•Table 5 suggests that there was a significant positive shift in 

, } • - ■ . V • 

the raw scores from the pre-test to post-test application of the S.E.S.A.T. II. 

\ ' 

A group of second grade students from P.S. 139 were given the M.A.T. 

. ■■ ' 1 ' • > ' 

>^ mathemaxics sub-test on a pre and post basis. Tliese results provided grade 

equivalent scores, and allowed an historical regression analysis where 

anticipated post means were compared with actual post mean scores. . ' 

■ . . ■ • 
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Dibit' 6 prosoiUfl the data for tho ncconcl k^^^^u rttuclcntH (17') from tht» - 
htatorical roKre^islon uaing ma Uk^nui l ics Hub-scort»8 on the Mctropoltlnn 
Achlovomenr Te^jt. 



'IMblo 6 *- Summ-iry pf M;Uhem;itic9 Dnia from Second Grade StudtMUa 
oil the N.A.T. , Using the Historical Rqgress Ion Ana lysis . 

Group N Value of Level of Pre-Tesl AnticipnXed Actual 
^ t / S ignif icance Mean Post Mean Post Mean 

Grade 2 17 + 1. 343- N.S. l/29 1.35 ' 1,42 



• Table 6 su-ggests that while the group of second grade students did 
make progress, and *did e^^ceed Che anticipatecf post test mean, the difference 
between the actual and the a^iticipated post test means was not significant 
at the ,05. level. 

Several othpr aspects of the project should be noted, at this time. 
The evaluation report from last year made two, basic, recommendations for 
Improvement of this project. Firstly, it was reconmended that the program 
be funded for a longef period of time, specif ically for the wbole school , 
'year and not only the late spr ing months ^ Financial ' cons traints did not 
allow this to b^- implemented during*the 1975-76 school year. Secondly, it 
wa3 reconmended that further supplies and materials be made available to the * • 

... _ ■ ^ . . 

program,, and this recoimeridation was implemented. The ' facilities for use 
within the program varied. One of the schools, P.S. 139, provided a separate ^ 
room, for the Educational Assistants to use. The other school, P.S. 152, * 
preferred jthe Educational Assistants to work directly in the classroom with 
the regular teachers and consequently did not provide a separate room for 

■ ■ 7',.:. . 

the program. In each case, however, tlje materials and supplies needed 



seemeid adequate for the job. 
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^- - The program .appeared be very close tq^t^at described in the ' * 

. ■ . ' ' * * ■ ' 

project proposal. Very' i5ew dis'crepancies existed, and»it seemed apparent 

• . • V ' ' ^ r . •■ * . • '■ 

. vthat the projject was servicing -^he 80 children suggested in the proppsal. 
The children be iilg served .were low functioning children, having diffi- 
' cultjes' in learning to re&d^and function in mathematics > :Th'e progiraoi 
a^Jpeate/ to be able to identify ch^Si^jj^n with needs ' for remediation , arid 

"attempted to begin the remediation process. 1 

■'. * , ■ 

• . ' « ■ • " ' <•.■■"■" 

\ ' ■ . . • 

Chapter IV: SUMMARY OF MAJOR FINDINGS V , CONCLUSIONS, AND RECOMMENDATIONS 

.' ' . • ■ ^ ■ . > ^ 

. This project was funded, in the middle of the school ^year, pre- 
testing began , in late February and instruction by the Educational 
Asslitarits began in March. Xlie^'-timi^ elapsed between pre and post testing 
was approximately two to .three months ; The a*£ tendance in the program was 

' ■ \ ' ■ V . . ■ - ■ " " ■ ' 

•exceptionally good arid the activities .^nd materials available were very 
appropriate. The project met the goal of servicing eighty children who 
showed signs of problems of learni»^^ow to read ^nd function in 
mathematics. . The identificatiqn- pliase of the project was very successful. 

The results of the testing suggest mixed, results . Evaluation 
objective #1, which ^oqused qn the remediation of reading problems in firs 

^ ' •"'.^^ - ' ■ ■, - ■ . ^ • 

.arid', second grades ptesdnted mixed ^^uccess . The first graders did not 

c ■ ■ ■ . ^ . ■ 

display significant posi tivo/results on^ the- S . E . S .A .T. ll. The second 
graders were split between one school which applied the S.E.S.A.T.II in 
error to the 'second grade. The results of this school provided signifi- 
cantly positive re^sults. The school Wh ich correctly used the M.A.T. with 
second graders to measure growth. in reading skills presented significantly 
negative results. The children did not achieve at the anticipated level. 
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^..Qbjective #2, which fptu&ed on v functioning in mathematics , -alsa 
presented mixed^. results . Grade one''T!HSfi^ented significant g^rowth.in 
* mathematica 'functioning on the S.E.S.A.T! !!• The group* of second graders 
who used the S.E.S.A.T. II incorrectly presented significant changes in^ 
raw score data. The group of second graders, who used the -M.A.'T. appropriately 
■ produced. positive 'but not. s ignificant results on the historical regression 
; analysis. This group of second grade students did surpass the anticipated 

level,, but not significantly, * ^ ; 

. > ■ . ' ... 

The statis tical* results have to be looked upon with caution. The 
rogr-am was very short; two to three months hardly accounta.^or the standard 
error of the instruments. Secondly, the use of two instruments instead of one 
which would measure across . first and second '|srade was a seemingly poor choice. 
Since eaoh analysis had to be ;broken down into groups of 31, 26 and 17 instead 

of 74, the sample size of the groups is relatively small. For all «'of the 

i » . \ 

above reasons, the statistical evidence has to be considered tentative, 

• . ■ • 

jl There are several recommendations which this evalua£or should lik^ 

to suggest for the improvement'^^pf^,.-t4te~-p4:oj^ . • *' . 

1. Such a program should, beigin at the beginning of the. school year, 
and it would be the recommendation that instead of serving the first and 
second grades, the program might better serve second and third grade students. 
This evaluator would be hesitant to try to identify students in the first 
year of school as pofc^Sntial Learning problems, unless the child had been in 
a Kindergarten program in that same School and . the child had been known to 
the 'school for at least a year, 

2. Given the level of training a.nd the backgrounds of the'.Educa tional " 
Assistants in public, schools , it would seem ess^ential that the reading 



" specialist in each part^tcipJating -schogj^ be given t^ime^J^o^ Supervise these 
Eoucational Assistants. To.be done^ffectively , it carmot be taken out 
of lunch time, e tc but should bjj^ in tTie program, Perhaps another • * 
professional in the district '.could' have time available to coordinate, 
train,. and supervise the two Educational Assistants^^ . 

• • .■ ■ • / • ■ - ' . ■ , v_ 

. 3, Jfliile the schog^ls involved in this current projec't vari& in 

■'•"■■■■/.. 
• their approach 'to the phy^s ica 1 placement of the Educational Assistants, 

" ■ ''^ / ■ J ^ / 

it would be the re(«mienda t ion of the evaluator that, a school should provld 
a w^rk room for the ^small group sass ions if the school wished- tp retain 



/ 
/ 



the program in fuUire years. The level of skill of the Edutatipnal . ' ' 
Asjg^tants seeme^d to make it a very difficult task for^this moderately 
trained 'staff/member to function within the regular classroom with all of 
the .distractions o^^^the regular instructional program in the same' class- 

"■ ) ■ r ' 

room, \ ' . » / 



, 4. Fina'lly, tfie instruments used for the collection . of data ''''' 

/ , ■ . • ■ ■ 

could be more appropriate for the task. A great deal of confusion was 

' evident: because of the fact^ tjjiat; two instruments were being used. ' Thet^e ,. 

^/are s^ver^-1 ins,truTqie.njts''t)n tK^~ market which are j^ust as diagnostic and 

■ ' " • . " • '-^ ■ 

would still cover bd'th; sthe first and the' second grades. Tliese instruments " 

should be considered to r-eplace both the Stanford Early -School Achievement 

Test and the Metropolitan Achievement Test, PiDssible replacemeilts would 

■ ^ ■ • , 

be the California Achievement Test, the Peabody Individual Achievement^ 

*(fe?t, or the Keymath Test, all" of which are diagnostic and would cover, 

the- needed spread in cjiass func tioning ^even if ti/e program were to include 

third graders next year. In any case, uniformity of testing shoulH be 

mainta ined, 

' , 1.5' • 



r . 



-14- 



J 



While the statistical results were mixed in this p'rogram, much **,; 

■ ' . .■ ' ; • . , ' . ^ ^ 

of the non-s tatis t'ical data suggests, that the project has a tremendous 
amount of value. "The diagnostic work which was done by the reading 
specialists was e:Ccel lent V The Individual or small groftp inrstruction 
appeared to be on t^get, and the children ee^tainly akemed in. rfCod of 
the remedial instruction. «To refund thi^ p^;oject oai a* late springs b4s is 
would appear to be of little valu^, Gi^n the fact that such a program 
could be started in Se'ptember with, some of the recoTTnneTtdat:.io,ns implemented, 
this evaluator would ^rongly recommend the refunding of this project as 
a very appropriate at tempt to intervene in the -school lives of young 
children in a very positive and prob^^j-V ^significant manner'.. It is . . 



recomme-nded that it be .continued* at 
year 1976-77. 




ame lev'el for the whole academic 
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